Tizen 3.0 's Window System Integration 
Layer of OpenGLES/EGL 8 Vulkan Driver 


(libtpl-egl, vulkan-wsi-tizen) 


Mun Gwan-gyeong 
Software R&D Center 
Samsung Electronics 


A 


Agenda 


Sien 3.0 Window System Architecture 


Sien 3.0 Window System Integration Layer of 
OpenGLES/EGL 


si libtpl-egl (Tizen Porting Layer for EGL) 


ZS fen 3.0 Vulkan WSI for Tizen 


si vulkan-wsi-tizen 


Copyright © 2016 Samsung Electronics, Co., Ltd. All rights reserved. 2 / 33 


Tizen 3.0 Window System Architecture 
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Components description 


$% TPL-EGL is an abstraction layer for surface and buffer management 
on Tizen platform aimed to implement the EGL porting layer of 
OpenGLES driver over various display protocols. 


$ Vulkan-WSI-Tizen wrapes vendor's vulkan ICDs and provides the 
WSI(Window-System Interface) for the tizen. 


$% Tizen Buffer Manager (TBM) provides the abstraction interface for 
the graphic buffer manager in Tizen. 


$% Tizen Display Manager (TDM) provides the abstraction interface 
for the display server, such a wayland server, to allow the direct 
access to graphics hardware in a safe and efficient manner as a 
display HAL. 
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Components description (cont.) 


$% EvasGL is a kind of Evas Object image for opengl and it is a GLES 
Wrapper. 


$% CoreGL is an injection layer of OpenGL ES that provides the 
following capabilities: 


“+ Support for driver-independent optimization (FastPath) 
“+ EGL/OpenGL ES debugging 
“+ Performance logging 
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Tizen Porting Layer for EGL (libtpl-egl) 


Tizen OpenGL ES and EGL Architecture 
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Tizen Porting Layer for EGL 


$ Tizen Porting Layer(TPL) Architecture 
“+ TPL provides implementation of EGL platform functions on Tizen platform 


EGL 


SE TPL Backend Interface 


e TPL? 
“+ Background 
# Various window system protocols in Tizen 
— Wayland , gbm , tom , X# (Tizen 3.0 Alpha) 
$ Needs to separating common layer (frontend, duplicated code) and backend for 
maintaining 
si Why TPL? 
# TPL-EGL APIs prevents burdens of EGL porting on various window system 
protocols. 


ZS dete GL Driver's Window System Porting Layer functions treat only TPL-EGL 
S. 


S If libtpl-egl has improved performance, then Vendor driver can get it without 
moditication of code. 
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TPL Frontend Interface 


$ Tizen Porting Layer Core Object 
“+ TPL Object 
Base class for all TPL objects 
si TPL Display 
Encapsulate native display object (wl_display, gom_device, 
tobm_bufmar ) 
“+ TPL Surface 


Encapsulate native drawable object (wl_surface, gom_surface, 
tom_surface_queue_h ) 
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Tizen Porting Layer for EGL 


$ TPL 
si Provides TPL objects which correspond to EGL objects 


e EEE Drivers internal 
EGLDisplay EGLSurface Driver's egl buffer ene 
; TPL Surface 
TPL Display (TBM. Surface Queue) TBM_Surface DMABUF 


BTT GL Drivers Object 
( ) TPL Object, TBM Surface 
(a= Window System / DRM Object 
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GLES Drawing API Flow 


EntryPoints Functions ani GL Drivers Window system EO TPL(Tizen Porting Layer) 
(egl entrypoints) porting Functions (tpl.c) 


| d TPL display creation & P 


egllnitialize ; e initialization i 
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| f£ Create TPL surface for the : 
eglCreateWindowSurface EGLSurface 
eglCreateContext 


EEE Get the buffer of the current : 
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Called from GL Driver's EGL 


Display window buffer tpl_surface_enqueue_buffer ; Porting Layer when the 
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Simple example of the Tizen Porting Layer 


AOL LLL re 
. 


tpl_display_t *dpy zm display Create 1 
tpl_surface_t *sfc = tpl_surface_create(dpy, ...); 
tbm_surface_h buf; 

while (1) 


buf = tpl_surface_dequeue_buffer(sfc); // get buffer 3 
/* Draw something */ 


tpl_surface_enqueue_buffer(sfc, buf); // post buffer 


H D 
WITT UA 


GOO 


In the GPU vendor driver, the "Draw something" part is what 

_ the GPU frame builder does. : 
_ TPL-EGL exposes the native platform buffer as tom_surface. If i 
_tbm backend uses drm_backend , GL Driver can get dma_buf : 
_ from tbm_surface's buffer object. ? 
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TPL Frontend API ( ol object) 


$ TPL Object 
€ Base class for all TPL objects 
€ Provide common functionalities of all TPL objects 


API Description 
tpl_object_reference Increase reference count of the given TPL object 
tpl_object_unreference Decrease reference count and destroy it if it becomes 0 
tpl_object_get_reference Get reference count of the given TPL object 
tpl_object_get_type Get type of the object (display or surface) 
tpl_object_set_user_data Set user data and free callback for destruction 
tpl_object_get_user_data Get user data 
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TPL Frontend API ( tpi display) 


s TPL Display 


“+ Encapsulate native display object (wl_display, gom_device, tobm_bufmgr) 


‘į Any other objects are created from TPL Display , they are inherited 


backend type from TPL Display. 


API 
tpl_display_create 
tpl_display_get 
tpl_display_get_native_handle 
tpl_display_query_config 
tpl_display_get_native_window_info 
tpl_display_get_native_pixmap_info 


tpl_display_get_buffer_from_native_pixmap 


Description 
Creates the TPL-EGL display object for the given native display 
Retrieve the TPL-EGL display for the given native display handle 
Get native handle of the given display 


Query pixel format information 
Query information on the given native window. 
Query information on the given native pixmap. 


Get native buffer from the given native pixmap. 
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TPL Frontend API (ol surface) 


$ TPL Surface 


“+ Encapsulate native drawable object (wl_surface, br surface, 
tbm_surface_queue_h) 
“si Main Features 
ZS Get the buffer for a surface 
$ Post the buffer to a surface of screen 


API Description 
tpl_surface_create Create a TPL-EGL surface for the given native drawable 
tpl_surface_get_display Get TPL-EGL display of the given surface 
tpl_surface_get_native_handle Get native handle of the given surface 
tpl_surface_get_type Get type of the given surface (Window or Pixmap) 
tpl_surface_get_size Get size of the given surface 
tpl_surface_dequeue_buffer Get buffer (as TBM_SURFACE) of the current frame for the given surface 
tpl_surface_validate Check current buffer is valid 
tpl_surface_set_post_interval Set post interval 
tpl_surface_get_post_interval Get post interval 
tpl_surface_enqueue_buffer Post to screen 
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Wayland Server / Client on libtpl-egl 
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Buffer Flow ( Wayland Server + GLES/EGL Driver ) 


tobm_surface_queue_release() 


Wayland Display Server 
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Vulkan WSI for Tizen (vulkan-wsi-tizen) 


Tizen Vulkan Architecture 


Vulkan Application 


i System boundary 
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Vulkan WSI for Tizen 


$s Objectives 
-* Applications should be able to use khronos vulkan loader 
-““ Do not modify khronos vulkan loader 
“+ Separate WSI binary across multiple vendor ICDs 
“+ Don't do any platform specific things, use TPL instead 
$s Architecture 
“+ WSI wraps the ICD and act like a complete ICD 


a’ 


Vulkan Application 
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Vulkan Loader ( Khronos Vulkan Loader ) 


$s Loader exposes vulkan symbols to applications (libvulkan.so) 


s Loader opens an ICD shared object file and dispatches ICD 
functions via vk_icdGetInstanceProcAddr() 


si This is recommended way according to the khronos loader 
document 


S Application calls a loader function, then loader function finally calls 
the dispatched ICD function 


“+ Vulkan is layered architecture 


libvulkan.so 
(loader) 


icd.so 
(vendor's) 


Application 
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Wrapping ICD ( vulkan-wsi-tizen ) 


$s Vulkan WSI Tizen acts like a complete ICD 


“+ Exposes vk_icdGetInstanceProcAddr() which dispatches all required 
vulkan functions 


$s Some functions are implemented in vulkan-wsi-tizen, while others come 
from vendor ICD 


ZS API Hooks 
“= Vulkan WSI Tizen hooks desired vulkan functions 


“+ Hooked vulkan-wsi-tizen functions are dispatched instead of ICD 
functions 


“+ vkGetInstanceProcAddr(), vekGetDeviceProcAddr() are hooked by default 
& If not, an (Vendor's) ICD function might be dispatched even though 


it is hooked by WSI WSI might call icd.foo 
inside of wsi.so 
libvulkan.so ulkan-wsi-tizen.so icd.so 
(loader) (vendor's) 


Wi jserved. 23 / 33 


Extension Merge ( vulkan-wsi-tizen | 


$ Extension Merge 
“+ vulkan-wsi-tizen merges extensions from Vendor ICD and vulkan-wsi- 
tizen’s own extension 


“+ vulkan-wsi-tizen hooks extension enumeration functions 
“+ vkEnumeratelnstanceExtensionProperties() in vulkan-wsi-tizen 


ZS Vendor ICD instance extension + VK KHR surface + 
VK_KHR_wayland_surface 


“+ vkEnumerateDeviceExtensionProperties() in vulkan-wsi-tizen 
S Vendor ICD device extension + VK_KHR_swapchain 


Vulkan-wsi-tizen 
merges extensions 


icd.so 
(vendor's) 


libvulkan.so | 
(loader) 


ulkan-wsi-tizen.so 


E SSS 
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WSI Surface Functions (Khronos Vulkan Loader) 


s WSI Surface Functions 
“+ Surface functions are implemented in the khronos loader 


“+ Surface object is passed to the vulkan-wsi-tizen when other WSI 
function is called 


$ ex) vkCreateSwapchainKHR 


“+ Data structure for the loader surface object can be accessed via 
vk_icd.h (Khronos Vulkan Loader’s header file) 


Ex) WSI Swapchain Functions 


libvulkan.so | 
(loader) 


icd.so 
(vendor's) 


ulkan-wsi-tizen.so 


E SSS 
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WSI Functions ( vulkan-wsi-tizen ) 


S WSI functions except surface functions are implemented and hooked 
s WSI function categories 
“+ Surface capability query functions 
s Formats, presentation support, ... 
# ex) vkGetPhysicalDeviceSurfaceCapabilitiesKHR(), 
vkGetPhysicalDeviceSurfaceFormatsKHR( ... 
“+ Swapchain functions 


ZS ex) vkCreateSwapchainKHR(), vkGetSwapchainlmagesKHR(), 
vkAcquireNextImageKHR(), vkQueuePresentKHR\() ... 


“+ Display functions 
# Required when presenting directly to a display device 
Ex) WSI Swapchain Functions 


icd.so 
(vendor's) 


libvulkan.so | 
(loader) 


ulkan-wsi-tizen.so 


| Se GO 
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Swapchain related API ( vulkan-wsi-tizen ) 


ZS Swapchain 
“+ Manages image (buffer) queue 
“+ vkAcquireNextlmageKHR() 
$% Acquire a next image from the presentation engine 
“+ vkQueuePresentKHR() 
S Present the given image to the presentation engine 
‘$+ Implemented using TPL surface 


ZS vkAcquireNextImageKHR() 
“+ tpl_surface_dequeue_buffer() 
“+ Find index of the dequeued buffer and return 


ZS vkQueuePresentKHR() 


TBM TBM TBM 
Surface Surface Surface 
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Vulkan WSI Tizen + Vendor's ICD interface 


S Vulkan WSI Tizen + Vendor's ICD interface 
“+ Vendor's ICD should provide functions required by the Vulkan WSI Tizen 
“© vk Uzenh 
S Defines functions ICD should provides 


# Vulkan WSI Tizen should be able to dispatch those functions via Vendor ICD's 
vk_icdGetInstanceProcAddr() 


s vkCreatelmageFromNativeBufferTIZEN () 
“+ It creates a Vklmage from a tizen native buffer (tbm_surface_h) 
It is called by vkCreateSwapchainKHR() of vulkan-wsi-tizen 
“+ Arguments 
$% [in] VkDevice 
— VkDevice is passed by vkCreateSwapchainKHR() 
$% [in] tom_surface_h 
— Native tizen buffer 
# [in] const VklmageCreatelnfo * 
— Properties of the native tizen buffer (dimension, format, ...) 
# [in] const VkAllocationCallbacks * 
— Allocation callbacks used for host memory allocation 
# [out] Vklmage * 
— Vendor ICD should create vklmage from tbm_surface. 
— vkAcquireNextImageKHR() uses this Vklmage. 
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Vulkan WSI Tizen + Vendor's ICD (cont.) 


S EE 


“+ When the vendor's vulkan driver ends up the handling of vklmage and it is 
ready to present (all waiting semaphores are triggered), Vendor ICD notifies to 
vulkan-wsi-tizen (NativeFenceFd is created by Vendor Driver. ) 


si It is called by vkQueuePresentKHR() of vulkan-wsi-tizen 
“ii Arguments 
ZS [in] VkQueue 
— VKQueue is passed by vkQueuePresentKHR() 
ZS [in] uint32 t 
— waitSemaphoreCount is passed by VkPresentInfoKHR of 
vkQueuePresentKHR() 
S [in] const VkSemaphore * 


— WaitSemaphore list is passed by VkPresentInfoKHR of 
vkQueuePresentKHR() 


S [in] Vklmage 

— Vklmage index is passed by VkPresentInfoKHR of vkQueuePresentKHR() 
ZS [out] int *NativeFenceFd 

— Vendor ICD should create NativeFenceFd from WaitSemaphore list. 

— vulkan-wsi-tizen waits NativeFeceFd by tobm_sync_fence_wait(). 
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Vulkan WSI Tizen + Vendor's ICD (cont.) 


E Ke 


It notifies the acquired Image which is ready to use to the Vendor's Vulkan 
Driver. 


€ It is called by vkAcquireNextImageKHR() of vulkan-wsi-tizen 
“+ Arguments 
ZS [in] VkDevice 
— VkDevice is passed by vkAcquireNextImageKHR() 
S [in] Vklmage 
— Vklmage index is passed by vkAcquireNextImageKHR() 
$ [in] int nativeFenceFD 


— Vulkan driver should wait this nativeFenceFD until Display Server 
triggers it. ( Display Server uses tobm_sync_timeline_inc() for triggering) 


— nativeFenceFD is created by tbm_sync_fence_create() 
S [in] VkSemaphore 

— Vendor ICD connects VkSemaphore to nativeFenceFD 

— When nativeFenceFD is triggered, Vendor ICD signals VkSemaphore 
ZS [in] VkFence 

— Vendor ICD connects VkFence to nativeFenceFD 

— When nativeFenceFD is triggered, Vendor ICD signals VkFence 
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Supported WSI Spec (Current State) 


$s Surface & Swapchain Functions 


vkCreateWaylandSurfaceKHR Provided by khronos loader 
vkDestroySurfaceKHR Provided by khronos loader 
vkGetPhysicalDeviceWaylandPresentationSupportKHR Done 
vkGetPhysicalDeviceSurfaceSupportKHR Done 
vkGetPhysicalDeviceSurfaceCapabilitiesKHR Done 
vkGetPhysicalDeviceSurfaceFormatsKHR Done 
vkGetPhysicalDeviceSurfacePresentWModesKHR Done 
vkCreateSwapchainKHR Done 
vkCreateSharedSwapchainKHR Not Implemented Yet 
vkDestroySwapchainKHR Done 
vkGetSwapchainlmagesKHR Done 
vkAcquireNextlmageKHR Done 

vkQueuePresentKHR Done 
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Supported WSI Spec 


ZS Present Modes 


VK_PRESENT_MODE_IMMEDIATE_KHR Not Implemented Yet 
VK_PRESENT_MODE_MAILBOX_KHR Done 

VK_PRESENT_MODE_FIFO_KHR Not Implemented Yet 
VK_PRESENT_MODE_FIFO_RELAXED_KHR Not Implemented Yet 


$ Display Functions 


vkCreateDisplaySurfaceKHR Provided by khronos loader 
vkGetPhysicalDeviceDisplayPropertiesKHR Not Implemented Yet 
vkGetPhysicalDeviceDisplayPlanePropertiesKHR Not Implemented Yet 
vkGetDisplayPlaneSupportedDisplaysKHR Not Implemented Yet 
vkGetDisplayModePropertiesKHR Not Implemented Yet 
vkCreateDisplayModeKHR Not Implemented Yet 
vkGetDisplayPlaneCapabilitiesKHR Not Implemented Yet 
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References 
S Project Git repogitory (https://review.tizen.org/gerrit/#/admin/projects/ ) 


Ede Repository 


libtpl-egl platform/core/uifw/libtpl-eg| Tizen Porting Layer for EGL 

vulkan-wsi-tizen platform/core/uifw/vulkan-wsi-tizen vulkan wsi tizen icd, it wrapps vendor icd and 
provides wsi for tizen 

libtbm platform/core/uifw/libtbm The library for the Tizen Buffer Manager 

coreg| platform/core/uifw/coreg| An injection layer of OpenGL ES / EGL 


wayland-tbm Wayland tbm is a protocol for graphics memor 


platform/core/uifw/wayland-tbm EE 


emulator-yagl platform/adaptation/emulator/emulator-yag| OpenGL ES / EGL driver for the emulator 


tpl-novice platform/core/uifw/ws-testcase Novice test framework for TPL 


ka libtpl- egl Reference Driver 
“+ The Emulator YAGL (OpenGLES / EGL driver for the emulator) is implemented 
by libtpl-egl. 
ʻi The following commit explains how to port the driver with libtpl-egl from the 
traditional drm-based driver. 


“+ Porting YAGL to the Tizen platform https://review.tizen.org/gerrit/#/c/67921/ 
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